Depth-Based Image Registration

Image registration is a fundamental task in computer vision because it can significantly contribute to high-level computer vision and benefit numerous practical applications. Though a lot of image registration techniques exist in literature, there is still a significant amount of research to be conducted because there are a lot of issues that need to be solved such as the parallax problem. The traditional image registration algorithms suffer from the parallax problem due to their underling assumption that the scene can be regarded approximately planar which is not satisfied in the case of large depth variation in the images with high-rise objects. With regard to the the parallax problem, a new strategy is proposed by leveraging the depth information via 3D reconstruction. One novel idea is to recover the depth in the image region with high-rise objects to build accurate transform function for image registration. Our method mitigates the parallax problem and can achieve robust registration results, which is validated by our experiments. Our algorithm is attractive to numerous practical applications.